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ABSTRACT 

Phase 2 of Project IN-STEP was conducted to revise, 
refine, and conduct further field testing of a new inservice teacher 
education model. The method developed (in Phase 1--see ED 003 905 for 
report) is an individualized, multi-media approach. Revision 
activities, based on feedback provided for Phase 1, include the 
remaking of six videotape lessons, development of an "Action 
Handbook" to supplement them, and revision of the 200-page self-study 
programed text. An elementary science curriculum, "Science--A Process 
Approach" (A A AS Science) , provided the content for the development of 
the model. During the 1969-70 school year 511 elementary school 
teachers in Palm Beach County and Alachua County, Florida, were 
admitted to IN-STEP training programs in AAAS Science. Both 
experimental and control groups were pre- and posttested with the 
Elementary Science Teachers Inventory (Lane). Analysis of data serves 
to further confita the hypothesis suggested by the results of Phase 
1: that the IN-STEP approach is an effective and efficient method of 
conducting inservice training (at least in AAAS Science). Conclusions 
were based on results obtained from Phase 1 und statistically 
significant gains in group mean scores of all the experimental 
instructional groups during Phase 2 (1969-70). (Author/JS) 
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INTRODUCTION 



Increasing demands upon teacher's time resulting from the pro- 
liferation of new curriculum innovations and the desire to increase 
educational efficiency have caused new complexities for in-service 
training of teachers. School systems and universities are fi ed 
with the problems of training large numbers of teachers while saddled 
with the twin dilemma of insufficient funds and inadequate numbers of 
qualified personnel to conduct acceptable in-service programs. 

An alternative to this predicament is shown in the development 
of Project 1H-STEP. The solution proposed by IN- STEP involves an in- 
dividualized, multi-media aporoach for teacher training. When this 
model is utilized an added benefit is accrued. This is e very 
effective method for implementing modern curriculum developments on a 
large scale in a short time. The vehicle chosen for developing and 
testing the model during the first two years of the program (Phases I 
and II) was the contemporary elementary science education program, 
Science - A Process Approach. 
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synopsis OF PHASE I 



During the early fall of 1968, 320 Palm Beach County teachers 
were pre-tested and placed in various prescribed instructional groups. 
There were four instructional groups and each group received varying 
amounts of instruction depending upon the proficiencies displayed by 
the pre-test. Those teachers who were placed in Instructional Group I 
served as a control group to assist in measuring the effectiveness of 
the program. The teachers were instructed by means of: 



1. Video tapes 

2. Self-study programmed text materials. 

3. Classes conducted by the IN-STEP instructors in 
which the participants actually used the AAAS 
classroom materials in a • hands on type of 
approach. 



At the end of the academic year 1968-69 the teachers were post- 
tested and a random selection of their students were also post-tested 
along with a random selection of matched students of teachers outside 
the program. The followirp, instruments were used in the specific 
evaluation: 



A. Teacher Participants 

1) Pre-test (elementary science teachers inventory) 

2) Post-test (elementary science teachers inventory) 

3) Teacher Attitude and Opinion Survey (Project IH-STEP 
Teacher Questionaire) 

B. Students of Teacher Participants 

1) Process Measure (Observation) 

2) Student Attitude (O-sort) 



Analysis of the data from the Phase I testing program suggests 
the acceptance of the hypothesis that the I*'-STEP approach** is a * 
successful method for conducting in-service training of teachers (at 
least for AAAS Science). This statement is based upon the following 
observations: 

1. Gain in the mean scores of Instructional Groups II, III 
and IV, generally at the .01 level of significance, due 
to the instructional program. 

2. The generally favorable attitude of the teachers who 
participated as reflected in the qusstionaiie . 



ERIC 
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3. The cost effectiveness comparison between training a 
hypothetical group of 300 teachers in AAAS Science 
with IN-STEP materials as compared with a traditional 
approach to training a like number of teachers. 

4. Indirect measure of teacher effectiveness in instructing 
students in the materials and methods gained from parti- 
cipating in Project IN-STEP training. Second grade stu- 
dents of participants showed a difference in the mean on 
the observation process measure when compared with a 
matched control group. The difference was significant 
at the .01 level. 

5. A moderately favorable indication of a difference in the 
attitude towards science in sixth grade children (only 
grade surveyed with 0-sort means) whose teachers were 
trained in AAAS Science via the IN-STEP program compared 
to a random sampling of other sixth grade children in the 
county. 

An abstract of the evaluation report on Phase 1 was published by 
ERIC in the March 1970 issue of Research In Education . The full text 
of the report can be obtained from ERIC at nominal cost. The report 
is available in either microfiche or hard cover . The results obtained 
from Phase I indicated that the pursuit of the^ Phase II objectives should 
prove worthwhile. \ ^ 



GOALS AND OBJECTIVES 



GENERAL OBJECTIVE (PROJECT GOAL) 



Tho general objective of Project IN-STEP is to develop an effec- 
tive, economical model for in-service training of teachers. 

The effectiveness is shown in Phases I and II by comparing pre 
and post-mean scores by participating teachers. The economic feasi- 
bility will be demonstrated by comparing costs of training a large 
number of teachers with the IN-STEP method to the traditional method 
of extension classes, using one college instructor per 30 participating 
teachers. 

In order to meet this general objective the total project program 
was divided into three phases of one year each. Each phase has its own 
operational objectives which lead to meeting the primary goal of the 
project. The operational objectives for Phase I dealt with the devel- 
opment, implementation and preliminary evaluation of the IN-STEP model 
(individualized, multi-media approach) fox' in-service training. 



OPERATIONAL OBJECTIVES 



Tor Phase II the operational objectives were as follows: 

1. To revise instructional programs and appraisal techniques 

in Phase I as indicated by the results of their effectiveness. 

2. To evaluate the effectiveness of the instructional approaches 
by implementing the program with other teachers using the re- 
vised procedures and materials and evaluating their effects. 
This evaluation was to be done by comparing the pre and post- 
test scores on the Elementary Science Teachers Inventory. A 
difference in the mean gain significant at the .01 level of 
reliability was to be considered successful. 
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PROCEPURES 



Objective I 



In order to meet the points of operational objective //I for 
Phase II, the following procedures were undertaken: 

1. Six of the videotape lessons were remade. 

2. A publication entitled Action Handb ook was developed by 
the project staff. The author was Karl L. Combs, staff 
instructor for Project IN-STEP. The Action Handbook is 
designed to strengthen the videotape portion of the in- 
structional program. This is accomplished in the Handbook 
by involving participants in activities correlated with the 
videotapes/kinescopes before, sometimes during and always 
after each telelesson. 

3. The 200 page self-study programmed text, written and de- 
veloped by the project staff was completely revised. 

4. A thorough evaluation of Phase I was undertaken. The 
results of this study are available from ERIC. An abstract 
of which was published in Research In Education v March, 1970. 



Objective II 



In the field testing and evaluation of the revised IN-STEP 
materials some modifications were made in Phase II. These modi- 
fications were due to several factors. Some were suggested in feed- 
back from Phase I. Others were manlated by constraints of available 
time and funds acting on both the participants and the IN-STEP staff. 
One example is that although 226 teachers were trained via IN-STEP in 
Palm Beach County during the 1969-70 school year, there we re no local 
funds available to supply them with teaching materials. This prevented 
them from implementing the AAAS materials per se. However, this did 
not prevent them from modifying their behavior somewhat in shifting 
towards a child-centered process approach in their classroom. It is 
apparent though that testing the students of these participants as 
to their acquisition of the skills inherent in AAAS science would not 
be valid > due to their not having access to the materials. This prob- 
lem also made use of the teacher questionaire rather unsuitable since 
many of the questions dealt with the teachers reaction to using the 
teaching materials in the classroom. The project staff, however, was 
able to collect much hard data during the 196 — 70 school year and it 
is the opinion of the staff that there was more than enough data gener- 
ated, collected and analyzed to provide a thorough evaluation of Phase 
II* 
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There was an interesting variation in the procedures this year in that 
the materials were also implemented in Alachua County, Florida, as well 
as Palm Beach County. The procedures for implementing the IN-STEP AAAS 
materials in these two separate instances are reported in the following 
sub-sections : 



Palm Beach County 

During the 1969-70 academic year in Palm Beach County 226 teachers 
received AAAS science training via the IM-STEP method. One hundred and 
ninety-two of these teachers were divided into three instructional groups 
on the basis of their performance of the Elementary Science Teachers In- 
ventory developed by Dr. Rodney A. Lane, Dean of the Division of Contin- 
uing Education, Florida Atlantic University. This instrument served as 
a pre and post-test in both Palm Beach and Alachua Counties. These 192 
teachers began instruction in the fall of 1969. The remaining 34 tea- 
chers vrere placed in a single group regardless of test score. This 
group was used as a control group and their instruction was begun in the 
spring of 1970. The treatment of the spring group corresponded to that 
given Instructional Group I during the 1968-69 field tests. The treat- 
ment of the various groups is listed below: 

Control (Spring) Group - This group received brief instruction in the 
philosophy of science education, met a limited number of classes and 
viewed a limited number of videotapes. Most of their time was devoted 
to involvement for procedures i.n unpacking and setting up AAAS teaching 
equipment. Very little information concerning the processes of S cience 
- A Process A pproach was presented to them. 

Group I - This group corresponded to the Instructional Group II of the 
1968-69 evaluation. They received self-study programmed materials, 
viewed eight telelessons, and attended eight two-hour classes. 

Group II - This group corresponded to the Instructional Group III of 
the 1968-69 field test. They received self-study programmed materials, 
viewed 15 telelessons and attended 10 three-hour classes. 

Group III - This group corresponded to the Instructional Group IV of 
the 1968-69 year. They received self-study programmed materials, viewed 
30 telelessons and attended 12 three-hour classes. 

f 

One variation in the treatment of the instructional groups during 
the 1969-70 year was the inclusion of more self-study materials. This 
was done in the form of the Action Handbook. 
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Alachua County 



During the fall and winter of 1969-70, 275 elementary teachers 
were trained in Science - A P roce ss App roach via IN-STEP materials 
in Alachua County, Florida. 

Based upon the results of the pre-test and also upon the felt 
needs of the individual teachers, teachers were asked to engage, 
to varying degrees, in the following aspects of an individualized 
in-service program: 

a. 'instruction in the philosophy and mechanics of Science - 
A Process Approach (via video tapes). 

b. Self-study text materials (programmed format). 

c. Instruction (rationale and sample lessons) and suggested 
ways to + a “.ch each of the major processes of AAAS Science. 
These a- 25-minute telecasts, each will be aired twice 
weekly. 

This was acco- d by placing the 275 teachers in one of 

three instruction • os. The pre-test used was the Elementary 
Science Teachers lnv«. ory. 



RESULTS 



Palm Beach County Statistical Data 



Due to the constraints of available time and funds already men^ 
tioned in the chapter on procedures, detailed study of only one in- 
structional group was possible. Instructional Group II was decided 
upon because it corresponded roughly with the Group III of the 1968-69 
year. Grcup III of that year showed the poorest mean gain of the total 
program so far (significant at the .02 level). Thus it was felt if the 
revised materials made an improvement in this group this would be sig- 
nificant, and would pose the biggest challenge if only one group could 
be evaluated. 



Table I 

Comparison of Teacher Pre and Post-Test Scores 
PALM BEACH COUNTY 
Unmatched Comparison 
Based Upon 52 Test Items 



Group II 



Pre-Test 



Post-Test 



(Experimental) N 109 

Range 14-34 M 21.85 



N 48 
M 23.09 



T= 3.08 

significance .01 



Hatched Comparison 
B ased Upon 52 Test Items 



Group II 



Pre-Test 



Post -Test 



(Experimental) N 48 

Range 16-27 M 21.29 



H 48 
M 23.09 



correlat-i^n .59 T= 5.02 significance .01 



RESULTS - Palm Beach County Statistical Data( Continued) 



Unmatched Comparison 
Based Upon 52 Test Items 



Spring Group 



Pre-Test 



Post-Test 



(Control) 
Range 10-38 



N 20 
fi 22.95 



M 



N 26 
23.36 



T= 1.17 

not significant at the .01 level 



Matched Comparison 
Based Upon 52 Test Items 



Spring Group 



Pre-Test 



Post-Test 



(Control) 
Range 10-38 



N 16 
M 20.93 



N 16 
M 22.25 



correlation .47 T= 1.96 

not significant at the .01 level 



Discussion of Teacher Pre and Post-Test Results 
Palm Beach County 

As was stated previously, due to certain constraints only Group II 
was selected for comparison with the control group. It may be noted 
that there are two sets of figures for both the experimental (Group II) 
and the control group (Spring Group). These are the matched and un- 
matched comparisons. Unmatched comparisons resulted from either fewer 
or greater numbers of persons taking the post-test. A matched compari- 
son involves only those taking both the pre and post-test. 

In examining the data we find that the control group did not show 
a significant gain in the difference between pre and post-test mean 
scores. The experimental group examined ( Group II) did show a marked 
gain in the difference between the pre and post-test mean scores. The 
difference was significant at the .01 level. This was most gratifying 
because, for reasons previously stated, it was felt that this group 
offered the greatest challenge to the 111-STEP instructional material. 



The experimental group for 1969-70 had a much larger T (unmatched 
3,08; matched 5.02) than the control group (unmatched 2.39, matched 
not available) for 1968-69. Variables in the instructional program 
which hopefully accounted for this improvement were the remaking of 
six videotapes, revising the self-study text and the development and 
use of the Action Handbook. 



Alachua County Statistical Data 



All the participating teachers in Alachua County were pre-tested 
with the Elementary Science Teachers? Inventory. This is a test de- 
signed to measure the teachers’ general science knowledge and their 
ability to apply the processes of science to solve problems. Teachers 
were placed in three instructional groups as follows: Croup I, Range 
10-22; Group II, range 23-33 Group III, range 34-43. 

Table II 

Comparison of Teacher Pre and Post-Test Scores 
ALACHUA COUNTY 
Based Upon 54 Test Items 





N 


X 

pre 


X 

post 


S.D. 

diff 


X X S.E. 

post - pre diff 


t 


Group I 

Pre test Range 10-22 


21 


17.4761 


27.5238 


4.9326 


10.0476 


1.1029 


9.1101 


Group II 

Pre test Range 23-33 


27 


28.5185 


35.1481 


5.4917 


6.6296 


1.0770 


6.1556 


Group III 

Pre test Range 34-43 


11 


37.5454 


41.7272 


3.8804 


4.1818 


1.2271 


3.4078 


Overall 

Pre test Range 10-43 


59 


26.2711 


33.6610 


5.4742 


7.3898 


0.7188 


10.2807 

L 



All t - ratios are statistically significant at or beyond the or = 0.01 level for a 
tailed test of significance. 

O 
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Table III 



Frequency and Amount of Change of Pre and Post-Test Scores 



Amount 

of 

Change 

0 

+1 
+2 
+3 
+4 
+ 5 
+6 
+7 
+8 
+9 
+10 
+11 
+12 
+13 
+ 14 
+15 
+16 
+17 
+18 
+19 



ALACHUA COUNTY 



Group I 
1 
0 
1 
0 
1 
1 
1 
1 
1 
2 
2 
3 
1 
1 
1 
1 
1 
0 
0 
2 



Group II 

3 
2 

4 
3 
2 
0 
1 
1 
1 
1 
1 
1 
1 
1 
1 
3 
0 
1 
0 
0 



Group III 
2 
1 
2 
1 
1 
1 
0 
1 
0 
1 
0 
0 
0 
1 
0 
0 
0 
0 
0 
0 



Overall 

6 

3 
7 

4 
4 
2 
2 

3 
2 

4 

3 

4 
2 

3 
2 

4 
4 
1 
0 

_2 

59 




- 11 - 



Table IV 



Comparison of Teacher P.~e and Fost-Test Scores 
Duval Elementary School 
ALACHUA COUNTY 
Based Upon 54 Test Items 



Individual 



Test Results 


Pre-Test 


Post-Test 


Gain 


A 


17 


38 


21 


B 


15 


36 


21 


C 


16 


32 


16 


D 


22 


32 


10 


E 


30 


45 


15 


F 


38 


44 


6 




Mean Pic Tent 


Mean Post-Test 


Mean Gain 




23 


37.83 


14.83 



T= 6.06 

significance .01 



Discussion of Teacher Pre and Post-Test Results 
ALACHUA COUNTY 

In Alachua County post-testing was done using a random sample rather 
than all participants for two reasons: 

1. Conclusion of the in-service program coincided with a ’’teacher 
shift" which occurred at the beginning of February. This shift 
concerned the transfer of a large number of teachers involved in 
a desegregation plan and made it impossible to do any county-wide 
testing at that time. 

2. Total post-testing was not necessary to obtain statistically sig- 
nificant data. 
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In addition it was possible to show the results from all the parti- 
cipating teachers in one school in tabular form (see Table IV). The 
participating teachers came from 24 elementary schools in Alachua County. 
The number of participating teachers (275) represents between 40 to 50 
per cent of the elementary teachers in Alachua County. It had been hoped 
that individual schools within the county could be compared but the de- 
segregation migrations rendered this procedure unfeasible. It was pos- 
sible, however, to find one school where those teachers involved in the 
training program did not shift. This school was Duval Elementary school. 
In testing for significance with the data from this school, Fishers' T 
test for difference between correlated pairs of means was employed. An 
obtained + of 6.06 was found to be significant at the .01 level. 
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